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A method for filtering digital video images 

The present invention relates to a method for removing blocking arte- 
facts from a frame of a digital video signal, which has been coded by 
blocks and then decoded, the coding method for a block being selected 
according to a predetermined set of coding types, in which method at 
least one pixel is selected for examination from at least one side of a 
block boundary, and a value of at least one pixel selected for examina- 
tion is corrected by filtering. The present invention relates also to a 
device for removing blocking artefacts from a frame of a digital video 
signal, which has been coded by blocks and then decoded, the coding 
method for a block being selected according to a predetermined set of 
coding types, which device comprises means for selecting at least one 
pixel for examination from at least one side of a block boundary, and a 
filter for correcting a value of at least one pixel selected for examina- 
tion. The present Invention relates furthemiore to a video encoder 
according to the preamble of Claim 22, a video decoder according to 
the preamble of Claim 24, a video codec according to the preamble of 
Claim 25, and a mobile terminal according to the preamble of Claim 26. 
The present invention relates furthermore to a storage media for storing 
a software program comprising machine executable steps for coding 
and decoding a digital video signal by blocks, for selecting the coding 
method for a block according to a predetermined set of coding types, 
for removing blocking artefacts from a frame of a digital video signal, for 
selecting at least one pixel for examination from at least one side of a 
block boundary, for correcting the value of pixels selected for exami- 
nation by filtering. 

A transmission system like the one shown in Figure 1 is generally used 
for transferring a digital video image in compressed form. The video 
image is formed of sequential frames. In some prior art video transmis- 
sion systems, for example ITU-T H.261/H.263 recommendations, three 
frame types are defined: an l-frame (Intra), a P-frame (Predicted or 
Inter), and a B-frame (Bi-directional). The l-frame Is generated solely on 
the basis of information contained in the Image Itself, wherein at the 
receiving end, this l-frame can be used to fomn the entire image. P- 
frames are formed on the basis of a preceding l-frame or P-frame, 
wherein at the receiving stage a preceding l-frame or P-frame Is 
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correspondingly used together with the received P-frame In order to 
reconstruct the image. The preceding l-frame is also used as a refer- 
ence frame as will be explained later in this description. In the composi- 
tion of P-frames. for Instance motion cohipensation Is used to 
5 compress the quantity of infomiation. B-f rames are formed on the basis 
of the preceding P-frame or l-frame and/or the following P- or l-frame. 

The frames are further divided into blocks. One or more such blocks 
forms a block region. There can generally be four different region types: 

10 Intra region, copy region, coded region/and not-coded region. An intra 
region Is a block region In which the blocks are coded independently 
without reference to any other frame. A copy region consists of blocks 
which are obtained by copying the content of the reference frame into 
exactly the same location without any motion compensated prediction. 

15 A coded region consists of blocks which are obtained using motion 
compensated prediction and prediction error coding. The prediction 
en-or is a difference between the pixel values of the actual frame and a 
reconstructed frame which is formed by using coding and decoding in a 
transmitting system. The prediction en-or is then coded and sent to a 

20 receiver. A not-coded region is obtained using motion compensated 
prediction only. In fact the not-coded region is equivalent to a copy 
region if the motion information equals 0. All the block regions of one 
frame are not necessarily similar types but one frame can comprise 
block regions which are of different types. 

25 

A current video frame to be coded comes to the transmission system 
10 as input data In(x.y). In the differential summer 11 it is transformed 
Into a prediction error frame En(x.y) by subtracting from It a prediction 
frame Pn(x,y) fomied on the basis of previous images. The prediction 

30 error frame is coded in block 12 in a manner described hereinafter, and 
the coded prediction en-or frame is directed to a multiplexer 13. To form 
a new prediction frame, the coded prediction error frame is also 
directed to a decoder 14, which produces a decoded prediction error 
frame £n(x,y) which is summed in a summer 15 with the prediction 

35 frame Pn(x.y), resulting In a decoded frame Tn(x,y). The decoded frame 
is saved in a frame memory 16. To code the next frame, the frame 
saved in the frame memory 1 6 is read as a reference frame Rn(x,y) and 
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in a motion compensation and predlcUon block 17 It is transfomied into 
a new prediction frame according to the formula 

Pn(x.y) = Rn[x + Dx(x,y).y + Dy(x,y)] (1) 

The pair of numbers [Dx(x,y), Dy(x.y)l is called the motion vector of the 
5 pixel at location (x.y) and the numbers Dx(x.y) and Dy(x.y) are the hon- 
zontal and vertical shifts of the pixel. They are calculated in a motion 
estimation block 18. The set of motion vectors [Dx(-), Dy(.)] consisting 
of all motion vectors related to the pixels of the frame to be compressed 
is also coded using a motion mode! comprising basis functions and 
10 coefficients. The coefficient values are coded and directed to the 
multiplexer 13, which multiplexes them into the same data stream with 
a coded prediction error frame for sending to a receiver. In this way the 
amount of information to be transmitted is dramatically reduced. The 
basis functions are known to both the encoder and the decoder. Some 
1 5 frames can be partly or entirely so difficult to predict that it is not practi- 
cal to use motion compensated prediction when coding them. These 
frames or parts of frames are coded using so-called Intracoding without 
prediction, and therefore it is not necessary to send motion vector 
information relating to them to the receiver. 

20 

In the receiver system 20, a demultiplexer 21 separates the coded pre- 
diction error frames and the motion information transmitted by the 
motion vectors and directs the coded prediction error frames to a 
decoder 22, which produces a decoded prediction error frame En(x,y), 

25 which is summed In a summer 23 with the prediction frame Pn(x,y) 
formed on the basis of a previous frame, resulting In a decoded frame 
tn(x,y)- The decoded frame Is directed to an output 24 of the decoder 
and at the same time saved in a frame memory 25. When decoding the 
next frame, the frame saved In the frame memory Is read as a refer- 

30 ence frame and transformed into a new prediction frame in the motion 
compensation and prediction block 26, according to formula (1) 
presented above. 

The coding method applied in block 12 to the coding of the prediction 
35 error frame or to the intracoding of a frame or part of a P-frame to be 
sent wrthout prediction, is generally based on a transformation, the 
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most common of which is Discrete Cosine Transfomiatlon, DOT. The 
frame is divided Into adjacent biocks sized e.g. 8x8 pixels. In coding 
and decoding, the blocks are processed independent of one another. 
The transformation is calculated for the block to be coded, resulting in a 

5 series of terms. The coefficients of these terms are quantized on a dis- 
crete scale in order that they can be processed digitally. Quantization 
causes rounding enrors, which can become visible in an Image recon- 
structed from blocks so that there is a discontinuity of pixel values at 
the boundary between two adjacent blocks. Because a certain decoded 

1 0 frame is used for calculating the prediction frame for the next frames, 
the errors can be propagated in sequential frames, thus causing visible 
edges in the image reproduced by the receiver. Image errors of this 
type are called blocking artefacts. 

15 Some prior art methods are known for removing blocking artefacts. 
These methods are characterized by the following features: 

- determining which pixel requires value correction In order to remove 
the blocking artefact, 

20 

- determining a suitable low-pass filtering for each pixel to be corrected, 
based on the values of other pixels contained by a filtering window 
placed around the pixel, 

25 - calculating a new value for the pixel to be corrected, and 

- rounding the new value to the closest digitized pixel value. 

Factors that influence the selection of a filter and the decision to use 
30 filtering can be, for example, the difference between the values of pixels 
across the block boundary, the size of the quantization step of the 
coefficients received as the transfomnation result, and the difference of 
the pixel values on different sides of the pixel being processed. 

35 It has been found that the prior art methods also tend to remove lines of 
the image that should really be part of ft. On the other hand, the prior 
art methods are not always capable of removing all blocking artefacts. 
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The objective of the present Invention Is to present a new kind of filter- 
ing arrangement for removing blocking artefacts. The invention also has 
the objective that the method and device according to it operate more 
reliably and efficiently than prior art solutions. 

5 

The method according to the Invention is intended to adjust filtering 
parameters according to the type of blocks whose boundary is to be 
filtered. Different filtering parameters are chosen according to the type 
of block on either side of the boundary in order to yield an improved 
1 0 filtering result. 

The objectives of the invention are achieved by adapting the selection 
of pixels for filtering and the filtering process more flexibly than before 
to the features of the frame and the environment of the filtering point 
15 and by taking into account the nature/type of the blocks to be filtered. 

The method according to the invention for removing blocking artefacts 
from a frame that has been coded by blocks, in which method at least 
one pixel from at least one side of the block boundary is selected for 
20 examination, is characterized in that the filtering applied on the block 
boundary depends on the block types of the frame In the environment 
of the block boundary. 

The invention also relates to a device for Implementing the method 
25 according to the invention. The device according to the invention Is 
characterized in that the filter has been an-anged to operate adaptively 
according to the block types of the frame in the environment of the 
block boundary. 

30 The encoder according to the invention Is characterized in that the filter 
has been arranged to operate adaptively according to the block types of 
the frame in the environment of the block boundary. The decoder 
according to the invention Is characterized in that the filter has been 
an-anged to operate adaptively according to the block types of the 

35 frame in the environment of the block boundary. The codec according 
to the invention is characterized in that the filter has been arranged to 
operate adaptively according to the block types of tiie frame in the en- 
vironment of the block boundary. The mobile terminal according to the 
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invention is characterized in that the filter has been arranged to operate 
adaptlvely according to the block types of the frame in the environment 
of the block boundary. The storage media according to the invention is 
characterized in that the software program further comprises machine 
5 executable steps for filtering adaptively according to the block types of 
the frame in the environment of the block boundary. 

Because blocking artefacts only occur at block boundaries, the filtering 
according to the invention is only applied to pixels at block boundanes 

1 0 and the Immediate vicinity thereof. Edges that are part of the Image can 
reside anywhere In the Image area. In order that only pixels containing 
blocking artefacts are selected for corrective filtering and that the qual- 
ity of edges that are part of the Image is not affected during filtering, the 
following assumptions have been made in the study that resulted In the 

15 Invention: 

The changes In pixel values associated with edges that are part of the 
Image, are generally larger than those associated with blocking arte- 
facts, and those edges within the image, where the pixel value change 
20 is small do not suffer considerably from the rounding of the pixel value 
difference caused by filtering. 

Because the image to be coded Is generally divided into blocks both 
vertically and horizontally, the image contains both vertical and horizon- 

25 tal block boundaries. With regard to vertical block boundaries, there are 
pixels to the right and left of the boundary, and with regard to horizontal 
block boundaries, there are pixels above and below the boundary. In 
general, the location of the pixels can be described as being on a first 
or a second side of the block boundary. In the filtering method accord- 

30 ing to the invention, the number of pixels to be corrected, the character- 
istic features of the filter being used and the size of the filtering window 
depend on the following factors: 

a) The type of block on either side of the boundary (Inter, copy, 
35 coded, not-coded), 

b) the difference In pixel values A across the block boundary 
(the difference can be defined In many ways; one definition is A = |ri - 



Saapunut : 20/ 1/ O 15:S9; 

■ 20/01 '00 16:02 FAX 03 288 




03 zesezez -> patrek 
TAKPEREEN PATENT 



ASIAKASPALVELU; 
-» PRE 



S±vu S 




Si 008 



7 



M where n is the value of the pixel on the first side of the block bound- 
aiy closest to the boundary, and I, is the value of the pixel on the sec- 
ond side of the block boundary closest to the boundary), 

5 c) the size of the quantization step QP of the coefftelents 

received as the result of the transfomiation used in coding, and 

d) differences in pixel values between the pixels on the first 

side of the block boundary, and correspondingly between the pixels on 
10 the second side of the block boundary. 

In the method and device according to the invention, the number of the 
pixels to be selected for filtering can vary, and it is not necessarily the 
same on different sides of the block boundary. The number of pixels 

1 5 also depends on the type of block on erther side of the boundary. 
Because the number of pixels Is adapted to the general features of the 
image information contained by the frame in a particular region accord- 
ing to the factors mentioned above, the method produces a better ifilter- 
ing result than that provided by prior art methods. A "better result in 

20 this context is one in which blocking artefacts are reduced to a greater 
extent while real edges In the image are affected to a lesser degree.. A 
larger amount of blocking artefacts can be removed without weakening 
the real image edges unreasonably. 

25 In the following, the invention will be described in more detail with 
reference to the prefenred embodiments and the accompanying draw- 
ings, in which 



30 



Figure 1 represents a prior art video codec. 

Figure 2 represents the location of pixels in relation to a block 

boundary in the method according to the Invention, 



Figures represents alternatives for locating the filtering method 
35 according to the Invention In a video codec, 

Figure 4 is a schematic representation of a device for Implementing a 

method according to the invention, 
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Figure 5 represents a device according to Figure 4 In operation, and 

Figure 6 is a schematic representation of a portable teleconferencing 
5 device implementing a method according to the Invention. 

In the above, in connection with the description of the prior art, refer- 
ence was made to Figure 1 , and so in the following description of the 
invention and its preferred embodiments, reference will be made mostly 
10 to Figures 2 to 5. The same reference numbers are used for corre- 
sponding parts In the figures. 

Rgure 2 shows the location of the pixels r-, - re and \^ - Is in relation to a 
vertical block boundary 30. To Implement the method according to the 

15 invention, certain parameters must be specified. The parameter n Is the 
largest number of pixels to be examined from the block boundary in one 
direction, and in the case of Rgure 2 Its value Is 6. It Is practical to 
select the value of the parameter n so that It has a certain relation to 
both the difference of the pixel values A across the block boundary and 

20 to the size of the quantization step QP of the coefficients received as 
the result of image coding. Furthermore, the value of the parameter n Is 
advantageously smaller than or equal to the number of pixels in the 
block in the direction of examination to avoid possible blocking artefacts 
associated with previous block boundaries spreading to the block 

25 boundary under examination. The following definition is recommended 
for use in a preferred embodiment of the invention applied to image 
blocks comprising 8x8 pixels: 



n = 
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wherein a = QP Iog(QP). If QP has a different value in blocks on differ- 
ent sides of the block boundary, the smaller value of QP Is used In cal- 
culation, as well as in all cases presented hereinafter, in which a defini- 
tion Includes reference to one QP value only. The Invention does not 
5 limit the determination of the value of parameter n, but according to the 
guidelines of the equation (2) ft is advantageous that its value is gen- 
erally higher when the difference of pixel values A across the block 
boundary is small in comparison to the size of the quantization step QP 
of the coefficients received as the result of the coding transformation. If 
1 0 the difference between the pixel values A is large, there is a high prob- 
ability that there is a real Image edge at the block boundary, and In this 
case the pixels are preferably not examined for filtering at all (n=0). 

In the next step of the filtering method according to the invention region 
15 type Information concerning the two neighbouring blocks is examined, 
I.e. the type of the blocks on both sides of the block boundary in ques- 
tion. According to the region type information the value of the parame- 
ter n may further be limited (truncated) to provide even better results for 
removing the blocking artefacts. The region type information Is included 
20 e.g. in the coded Information of pixels of one block wherein that infor- 
mation Is maintained, or temporarily stored, during the decoding of the 
information of the block until a tmncated value of parameter n is 

defined. 

25 Table 1 shows the truncation values according to an advantageous 
embodiment of the present invention. Table 1 applies in a situation 
where the maximun vaJue of n is 6, and, of course, different truncated 
values would be appropriate in situations where this maximum value is 
other than 6. These truncation values are used for the first and second 

30 sides of the block boundary depending on the region type of the block 
on the first side of the block boundary and on the region type of the 
block on the second side of the block boundary. 
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TABLE 1 



Each cell of Table 1 corresponding to a particular region type combina- 
tion Is split into two parts. The value on the left gives the truncation 

5 value trval for the first side of the block boundary and the value on the 
right gives the truncation value trval for the second side of the bound- 
ary. If the value of the parameter 'n' exceeds the value given in Table 1 , 
'n' is truncated to the truncation value trval in Table 1 . If, however, the 
value of the overall activity parameter 'n' does not exceed the value 

10 given In Table 1, the value of the parameter n (originally determined 
from equation (2)) is retained. In Table 1 the symbol "n" Indicates that 
further truncation is not performed and the parameter value is retained. 
The truncated value n,r for the parameter n can also be presented by 

the formula: 

15 

n^, = min(trval,n), (3) 

The same table can be used both for flitering across vertical block 
boundaries (horizontal filtering) by putting "Left"/"Right" in place of 

20 "FlrsrrSecond" and for filtering across horizontal block boundaries 
(vertical filtering) by putting "BottomTUp" in place of "Flrst"/"Second", 
respectively. Now. the value on the left gives the truncation value for 
the pixels on the left/below the block boundary and the value on the 
right gives the truncation value for the pixels on the right/above the 

25 boundary. 

To further clarify the use of Table 1 , an example situation is presented 
in the following. In this illustrative example situation "horizontal filtering" 
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is performed across a vertical block boundary 30. Assuming that the 
value for parameter n calculated from equation 2 is e.g. 4. the block on 
the left-hand side of the block boundary 30 In question Is Intra type, and 
the block on the right-hand side of the block boundary 30 In question is 

5 Not-coded type. Table 1 indicates that the truncation value for the left- 
hand side is 'n' and the truncation value for the right-hand side is 2. 
This means that the 4 pixels closest to the block boundary (=the caJcu- 
lated value of n) are selected for filtering from the left-hand side of the 
boundary, and 2 pixels closest to the block boundary (=^the truncated 

1 0 value of n) are selected from the right-hand side for filtering. 

Another example situation is presented In the following. In this illustra- 
tive example situation "horizontal filtering" is performed across a vertical 
block boundary 30. Assuming that the value for parameter n calculated 

15 from equation (2) Is e.g. 4, blocks on both sides of the block boundary 
30 in question are Copy type, Table 1 indicates that the truncation 
value for the left-hand side Is 2 and the truncatton value for the right- 
hand side is 2. This means that the 2 pixels closest to the block 
boundary (^he truncated value of n) are selected for filtering from the 

20 left-hand side of the boundary, and 2 pixels closest to the block bound- 
ary (=the truncated value of n) are selected from the right-hand side for 
filtering. 

For bidirectionally predicted frames (B-frames). truncation of the 
25 parameter n is not applied because there Is no unique block type infor- 
mation. 

The next step in the filtering method according to the invention is to 
determine the values of the parameters d, and dr, which represent 
30 activity, or the differences of pixel values between pixels on one side of 
the block boundary. A preferred definition for dr Is the following: 

= 6, if |r, - rjl < p/j with all j€ [1 ,6], 
otherwise: dr = i, where i fulfils the conditions 
35 I6[l. n,,]. (4) 

|ri - ri.,| > p/i, and 
r 1 - nl < p/j with all jG[l.i]. 
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Here, the auxiliary parameter p - 4 log(QP). The value of parameter d, 
is determined similarly, except that all r's are replaced by I's and the 
corresponding truncated value n„ for the parameter n must be used. 

■me number 6 appears in definition (4) because the highest possible 
5 value of n Is 6 according to equation (2). If n is defined differently, but 
the parameters dr and d, are defined according to definition (4), the 
number 6 must be replaced by the highest possible value of n accord- 
ing to the new definition. 

1 0 With regard to the invention, it is advantageous that the values of the 
parameters dr and d, are calculated independent of one another, 
because the image information contained by the frame can be different 
on different sides of the block boundary. The invention does not limit 
the definition of parameters dr and d|. but according to the guidelines of 

1 5 definition (4) it is advantageous that these parameters are used to limit 
the blocking artefact processing relatively close to the block boundary, 
if there is a real Image edge near the block boundary. The essential 
features of definition (4) can be summarised as follows: the value of 
parameter d, (and correspondingly the value of parameter d|) provides 

20 an indication of how many pixels counted from the block boundary have 
approximately the same value as the pixel at the block boundary. 

A high value of parameter n (e.g. 6) indicates that the difference 
between the pixel values at the block boundary is relatively small com- 

25 pared with the general variation of the pixel values within the block. In 
this case, it is possible that there is a real image edge near the block 
boundary. By selecting a sufficiently small value of parameter dr (or d|), 
it is possible to restrict the filtering aimed at correcting blocking arte- 
facts so that it does not have a deteriorating effect on a real image 

30 edge close to the block boundary, in some situations, a large number of 
pixels counted from the block boundary have approximately the same 
value as the pixel at the block boundary. In that case, definition (4) 
would give the parameter dr or (di) a relatively high value. However, if 
there is a clear discontinuity in pixel values between the blocks, the 

35 parameter n has a small value and the truncated value n^r Is used in 

the definition (4) which make sure that an unreasonably high value is 
not selected as the value of the parameter dr (or di). Otherwise, a rela- 
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tively high value of tha parameter d, (or di) would result In unnecessary 
filtering. 

If blocks on both sides of the block boundary are Intra-type blocks, the 
5 truncation has no effect on the selection of the parameter values n, dr 
and d|. On the other hand, if at least one of the blocks has a type other 
than Intra, the truncation of the value n according to the formula (3) 
may limit the number of pixels filtered. This has the advantage that the 
block boundaries are not smoothed too much. 

10 

In addition, the largest possible number of pixels to be filtered must be 
decided, i.e. filtering window. This does not have a notation of its own in 
Figure 2, but it can be e.g. 3, which means that filtering can only be 
used to correct the value of the pixels ri, r2, r^, I2 and I3. 

15 

When the values of the parameters n, n^^, dr and di have been deter- 
mined, filtering Is carried out using a suitable filter. The Invention does 
not limit the kind of filter that can be used, but a filtering arrangement 
that has been found preferable, will be described in the following. Fllter- 

20 ing is used to determine a new value for the pixels selected for filtering. 
In a preferred embodiment of the invention, a new pixel value is deter- 
mined for a given pixel by calculating the mean of the pixel values that 
appear in a filtering window.. In the preferred embodiitient, the filtering 
window is symmetrical with regard to the pixel to be filtered and con- 

25 tains, in addition to the pixel to be filtered, one, two or three pixels from 
its both sides, depending on the values of the parameters dr and di as 
described hereinafter. Of course these are only examples and other 
values could be chosen in situations where n, n^^* end d| are defined 
differently. The calculated mean value is rounded to the closest digit- 

30 Ized pixel value, whereby it becomes the new value of the filtered pixel. 

Table 2 shows the determination of the width of the filtering window for 
the pixels r^, rz and according to the value of parameter d, in a pre- 
ferred embodiment of the invention. The values of the pixels I1, 1^ and I3 
35 are determined in the same manner according to the value of the 
parameter di- In the table, X means that the pixel in question is not fil- 
tered at all, and the number means that the filtering window includes a 
number of pixels shown by the number from each side of the pixel 
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being examined. Among other things, Table 2 shows that for filtering to 
be applied to any pixel, parameters dr and di must both have a value 
greater than 1 . 



d, (d,>1) 




r? I fa 


1 


X 


X 


X 


2 


1 


X 


X 


3 


1 


1* 


X 


4 


2 


2 


X 


5 


2 


2 




6 


3 or 2*** 


3 ' 


3 



5 

the filtered value of pixel ri is used for filtering of pixel ra 
the filtered values of pixels n and r2 are used for filtering 
pixel Fg 

3 If di > 2, otherwise 2. 

10 

The above description relates to implementing the filtering on one hori- 
zontal part of a pixel row, which part is 1 2 pixels long and located sym- 
metrically on both sides of a vertical block boundary. The description 
can be easily generalized to concern vertical parts of pixel columns, 

15 which are located symmetrically on both sides of a horizontal block 
boundary: Rgure 2 can be turned 90 degrees counter-clockwise, 
whereby block boundary 30 becomes horizontal, and the pixels shown 
in the figure form part of the vertical pixel column so that pixels ri - rg 
are the pixels above and pixels h - le are the pixels below. To filter block 

20 boundaries throughout the whole frame by applying the method accord- 
ing to the invention, all vertical block boundaries of the frame are exam- 
ined row by row and all Its horizontal block boundaries column by 
column. The order has no significance at such, and thus all the horizon- 
tal block boundaries of the frame could be examined first column by 

25 column, and then all the vertical block boundaries row by row. In an 
advantageous embodiment of the invention the filtering Is repeated line 
by line, i.e. the first line of the pixels in the blocks (besides the bound- 
ary) is filtered first, then the second line, etc. 
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Figure 3 shows at which points the prior art Image codec can be 
improved by applying filtering according to the invention. The first alter- 
native is to place the block implementing the filtering according to the 
invention In the output of the decoder of the receiver as illustrated by 

5 reference number 31 . In this case, block boundaries in the video frame 
are only filtered after decoding of all blocks within the frame. This 
requires block type information to be stored for all the blocks in one 
frame. Another alternative is to place the block carrying out the filtering 
according to the invention In the receiver before the point at which the 

10 decoded frame is directed to the frame memory 25 for forming a pre- 
diction frame, as illustrated by reference number 32. In this case block 
type information for all blocks within the frame must also be stored, as 
block boundary filtering is still performed after decoding and recon- 
staicting the entire frame. However, this altematlve has the advantage 

15 that the removal of blocking artefacts also has an effect on the forma- 
tion of a prediction frame, whereby blocking artefacts in one frame are 
not propagated via the prediction frame to the next frames. In order to 
achieve the last mentioned effect, the block performing filtering acconJ- 
ing to the invention can be placed before the frame memory 25 or after 

20 it, but the location shown by reference number 32 is preferred, because 
when applied at this stage, the filtering influences simultaneously the 
frame to be output by the receiving decoder and the frame to be saved 
in the memory. In the transmitter, the block carrying out filtering accord- 
ing to the Invention can be placed as shown by reference numbers 33 

25 and 34 before the frame memory 1 6 or after it, if it is desired that the 
invention Is also applied to producing a corrected prediction frame at 
the transmission end. 

The block carrying out Vne filtering according to the invention Is particu- 
30 lariy advantageously implemented in a digital signal processor or a cor- 
responding device suited for processing a digital signal, which can be 
programmed to apply predetermined processing functions to the signal 
received as input data. At the programming stage of the digital signal 
processor, the definitions 35 - 39 are saved according to Figure 4 for 
35 calculating the parameters that oontnal filtering. During operation 
according to Figure 5, the frame is saved temporarily In the register 41 , 
so that it can be processed In the signal processor pixel by pixel. A 
number of pixels indicated by the parameter n,r are selected from the 
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frame as the pixels to be examined 42 at a given Instant from each side 
of a certain point of a certain block boundary, the d-parameters 43 are 
calculated, filtering 44 is perfomied, and these measures are repeated, 
until all boundaries of ail blocks have been filtered/processed, after 
5 which the frame can be output from the register 41 and a new frame 
saved for processing. The measures according to Figures 4 and 5 can 
be carried out in a separate signal processor or they can be part of the 
operation of such a general processor vvhich also contains other 
arrangements for signal processing. 

10 

A storage media can be used for storing a software program comprising 
machine executable steps for performing the method according to the 
invention. Then In an advantageous embodiment of the invention the 
software program can be read from the storage media to a device com- 
15 prising programmable means, e.flr. a processor, for performing the 
method of the invention. 

The invention can be modified without departing from the scope defined 
by the claims hereinafter, using the capabilities of a person skilled in 

20 the art without actual inventive steps. For example, the parameter A 
can be calculated using the formula A = |(ri + r2) - (li + Ig)! or some other 
formula regarded as suitable. The definitions of other parameters 
above have also been intended as examples only. A particularly advan- 
tageous use of the invention is in mobile teleconferencing applications, 

25 digital television receivers and other devices that at least receive and 
decode digital video image. 

Figure 6 shows a mobile terminal 46 intended for use as a portable 
teleconferencing device and applying the deblocking filter method 

30 according to the invention. The mobile terminal 46 comprises advanta- 
geously at least display means 47 for displaying images, audio means 
48 for audio information, keyboard 49 for Inputting e.g. user commands, 
radio part 50 for communicating with mobile network (not shown), proc- 
essing means 51 for controlling the operation of the device, memory 

35 means 52 for storing information, and preferably a camera 53 for taking 
images. 
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The present invention is not soleiy restricted to the above presented 
embodiments, but it can be modified within the scope of the appended 
claims. 
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Claims: 

1 , A method for removing blocking artefacts from a frame of a digital 
video signal, which has been coded by blocks and then decoded, the 

5 coding method for a block being selected according to a predetermined 
set of coding types, in which method at least one pixel (n) Is selected 
for examination from at least one side of a block boundary (30), and a 
value of at least one pixel selected for examination is corrected by 
filtering, characterized in that the filtering applied on the block 
10 boundary depends on the block types of the frame in the environment 
of the block boundary (30). 

2. A method according to Claim 1, characterized in that the number 
of pixels (n) selected for examination depends on the image content of 
the frame in the environment of the block boundary (30), and that the 

15 number of pixels (n) selected for examination further depends on the 
block types of the frame in the environment of the block boundary (30). 

3- A method according to Claim 2, characterized in that the number 
of pixels selected for examination depends on the size of the 
quantization step of the coefficients used in the coding of the blocks. 

20 4. A method according to Claim 3, characterized in that the number 
of pixels (n) selected for examination is determined by the formula 

0 A > 2.00a 

1 150a < A <2.00Qr 

2 lX)Oa< A <l50a 
71 = ^3 0.66a < A <L00a , (2) 

4 0.40a < A < 0.66a 

5 0-25a< A < 0.40a 

6 0< A <025a 

wherein a = QP Iog(QP) and QP is the size of the quantization step of 
the coefficients used In the coding of the blocks. 



25 



5. A method according to Claim 2, 3, or 4, characterized in that the 
number of pixels (n) is first defined according to the image content of 
the frame in the environment of the block tx^undary (30). and the 
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number of pixels (n) Is further truncated according to the block types of 
the frame in the environment of the block boundary (30). 

6. A method according to Claim 5, characlerlzed in that the 
truncated value (n,r) of the number of pixels (n) is determined by 
selecting a truncation value (trval) according to the table 



Region type 
of the Block 
on the First 
side 

INTRA 



COPY 



Reaion type of the Block on the Second side 



INTRA 



n 



n 



COPY 




CODED 



n 



NOT CODED 



n 



and using said selected truncation value (trval) with the formula 
n,r =min(trval,n), 



(3) 



7. A method according to any preceding Claim, characterized In that 
certain pixels to be filtered are selected from the pixels selected for 
examination, and a new value is determined for each pixel to be filtered 
on the basis of pixels that appear in a filtering window set around the 
pixel. 

8. A method according to Claim 7, characterized in that the new 
value of the pixel to be filtered is the mean value of the pixels that 
appear in the filtering window. 

9. A method according to Claim 7, characterized in that for 
determining a new value for the pixels to be filtered on the first side of 
the block boundary, said filtering window is used, and the size of the 
window is determined by the table 
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where 

the filtered value ot pixel ri Is used for filtering of pixel h 
the filtered values of pixels r, and rz are used for filtering 
pixel rg 

3 If di > 2. otherwise 2, 
wherein an integer parameter d, indicates activity on the first side of the 
block boundary, and an integer parameter d, indicates activity on the 
second side of the block boundary, r,, r? and fa are the three pixels on 
the first side of the block boundary closest to the boundary in this order , 
X means that the pixel is not filtered, the number means that in addition 
to the pixel to be filtered, a quantity of pixels shown by the number are 
taken to the filtering window from both sides of the pixel to be filtered, 
and "3 or 2" means "3, if d, > 2, othenwise 2". and for detemnlning the 
new value of the pixels to be filtered on the other side of the block 
boundary, a filtering window defined similarly is used, with the 
exception that all r's are replaced by I's and vice versa. 

1 0. A method according to Claim 9. characterized in that 

dr = 6. If In - rjl < p/j with all je [1 ,6], 
othenwise: dr = i, where i must meet the conditions 
le[l,n,rl, 

|r, - rwl > p/i. and 
|r,- rjl <p/j with all j6[l,il. 



wherein the auxiliary parameter P = 4 log(QP) and QP is the size of the 
quantization step of the transformation coefficients used m 
transformation coding of the blocks, and the value of the parameter d, is 
determined similarly, with the exception that alt r's are replaced by I's. 
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11. A device for removing blocking artefacts from a frame of a digital 
video signal, which has been coded by blocks and then decoded, the 
coding method for a block being selected according to a predetermined 
set of coding types, which device comprises means for selecting at 
5 least one pixel (n) for examination from at least one side of a block 
boundary (30), and a filter for correcting a value of at least one pixel 
selected for examination, characterized in that the filter has been 
arranged to operate adaptively according to the block types of the 
frame in the environment of the block boundary (30). 

10 1 2. A device according to Claim 1 1 , characterized in that it comprises 
means (41 ) that operate adaptively according to the Image content of 
the frame, for selecting pixels for examination and filtering, and that 
means (41) for selecting pixels for examination and filtering comprises 
further means (42) for examining block types of the frame in the 

15 envlronmentof the block boundary (30). 12. A device according to 
Claim 1 1 , characterized in that It comprises means (42) for selecting 
the number of pixels for examination depending on the size of the 
quantization step of the coefficients used In the coding of the blocks. 

13. A device according to Claim 12, characterized in that the means 
20 (42) for selecting the number of pixels for examination comprises 
means (35) for determining said number of pixels by the fomnula 

0 A &2.00Qr 

1 l5Qa< A < 2.00a 

2 l.OOcir^ A <150a 

3 0.66a^ A <1.00ar . (2) 

4 0.40or< A <0.66a 

5 0.25a ^ A < 0.40a 

6 Oi A <025a 

wherein a = QP.Iog(QP) and QP Is the size of the quantization step of 
the coefficients used in the coding of the blocks. 

25 14. A device according to Claim 1 1, 12, or 13, characterized In that it 
comprises means (42) for truncating the number of pixels (n) selected 
for examination on the basis of said block types 



n = ^ 
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1 5. A device according to any of the Claims 1 1 to 1 4. characterized in 
that the means (42) for selecting the number of pixels for examination 
comprises means for defining the number of pixels (n) according to the 
image content of the frame In the environment of the block boundary 
(30), and means for truncating the number of pixels (n) according to the 
block types of the frame in the environment of the block boundary (30). 

1 6. A device according to Claim 1 5, characterized In that the means 
for truncating the number of pixels (n) comprises means for selecting a 
tmncation value (trval) according to the table 



Type of the Block on the Second side 




and using said selected truncation value (trval) with the formula 
ntr =min( trval, n), 



(3) 



1 7. A device according to any of the Claims 11 to 1 6. characterized In 
that It comprises means (42) for selecting pixels to be filtered from the 
pixels selected for examination, means (42) for defining a filtering 
window, and means for determining a new value for each pixel to be 
filtered on the basis of pixels that appear in a filtering window set 
around the pixel. 

18. A device according to Claim 17. characterized in that the means 
for detennlning a new value for each pixel comprises means for 
calculating mean values of the pixels that appear In the filtering window. 

19. A device according to Claim 17, characterized In that the means 
for determining a new value for each pixel comprises means for using 
said filtering window for the pixels to be filtered on the first side of the 
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block boundary, and means for determining the size of the window by 
the table 



d, (d,>1) 






rs _ 


1 


X 


X 


X 


2 


1 


X 


X 


3 


1 


r 


X 


. 4 ' 


2 


2 


X 


5 


2 


2 


2" 


6 


3 or 2"* 


3 


3 



5 where 

the filtered value of pixel r, is used for filtering of pixel ra 
the filtered values of pixels ri and Tz are used for filtering 
pixel fa 

1 0 3 if d| > 2, otherwise 2, 

wherein an integer parameter dr indicates activity on the first side of the 
block boundary, and an integer parameter di Indicates activity on the 
second side of the block boundary, ri, rz and are the three pixels on 
the first side of the block boundary closest to the boundary In this order, 

15 X means that the pixel is not filtered, the number means that in addition 
to the pixel to be filtered, a quantity of pixels shown by the number are 
taken to the filtering window from both sides of the pixel to be filtered, 
and "3 or 2" means "3, if d, > 2, othenwise 2". and means for using a 
filtering window defined similariy for determining the new value of the 

20 pixels to be filtered on the other side of the block boundary, with the 
exception that all r's are replaced by I's and vice versa. 

20. A device according to Claim 1 9, characterized In that 

dr = 6. If |r, - rjl < p/j with all je [1 ,6], 

otherwise: dr = i, where i must meet the conditions 

25 le[l,nv^]. 

In- rwl >p/l, and 

|r,- r,| < p/j with all je[l,ij, 
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wherein the auxiliary parameter p = 4 log(QP) and QP is the size of the 
quantization step of the transformation coefficients used in 
transformation coding of the blocks, and the value of the parameter d| 
being determined similariy, with the exception that all r's are replaced 
5 byl's, 

21 . A device according to any of the Claims 1 1 to 20, characterized In 
that it comprises programmable means (42) for selecting pixels from 
the saved frame as the pixels to be examined, programmable means 
(45) for selecting the pixels to be filtered from among the pixels to be 

10 examined, and programmable means (44) for determining the new 
value of the pixels to be tittered. 

22. A video encoder (10) comprising means (35 — 44) for coding and 
decoding a digital video signal by blocks, means for selecting the 
coding method for a block according to a predetermined set of coding 

1 5 types, which encoder comprises means for selecting at least one pixel 
(n) for examination from at least one side of a block boundary (30), and 
a filter for correcting the value of pixels selected for examrnation, 
characterized in that the filter has been arranged to operate adaptively 
according to the block types of the frame In the environment of the 

20 block boundary (30). 

23. A video decoder (20) comprising means (35—44) for removing 
blocking artefacts from a frame of a digital video signal, which has been 
coded by blocks and then decoded, the coding method for a block 
being selected according to a predetermined set of coding types, which 

25 video decoder comprises means for selecting at least one pixel (n) for 
examination from at least one side of a block boundary (30), and a filter 
for correcting the value of pixels selected for examination, 
characterized in that the filter has been arranged to operate adaptively 
according to the block types of the frame In the environment of the 

30 block boundary (30). 

24. A video codec (10, 20) comprising means (35 — 44) for coding and 
decoding a digital video signal by blocks, means for selecting the 
coding method for a block according to a predetermined set of coding 
types, means for removing blocking artefacts from a frame of a digital 

35 video signal, which video codec comprises means for selecting at least 
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one pixel (n) for examination from at least one side of a block boundary 
(30), and a filter for con-ectfng the value of pixels selected for 
examination, characterized in that the filter has been arranged to 
operate adaptively according to the block types of the frame in the 
5 envlronmentof the block boundary (30). 

25. A mobile temnlnal (46) comprising a vWeo codec (10, 20), which 
comprises means (35—44) for coding and decoding a digital video 
signal by blocks, means for selecting the coding method for a block 
according to a predetermined set of coding types, means for removing 

10 blocking artefacts from a frame of a digital video signal, which video 
codec comprises means for selecting at least one pixel (n) for 
examination from at least one side of a block boundary (30), and a filter 
for correcting the value of pixels selected for examination, 
characterized in that the filter has been arranged to operate adaptively 

15 according to the block types of the frame In the environment of the 
block boundary (30). 

26. A storage media for storing a software program comprising 
machine executable steps for coding and decoding a digital video 
signal by blocks, for selecting the coding method for a block accorcling 

20 to a predetermined set of coding types, for removing blocking artefacts 
from a frame of a digital video signal, for selecting at least one pixel (n) 
for examination from at least one side of a block boundary (30), for 
correcting the value of pixels selected for examination by filtering, 
characterized In that the software program further comprises machine 

25 executable steps for fiKering adaptively according to the block types of 
the frame In the environment of the block boundary (30). 



20/ 1 / O 1 6: OS ; 
•00 16:08 FAl 03 2886 




03 saaezez -> patrek asia kas palvelu 
TAHPEREEN PATENT PRH 




Abstract: 

The Invention relates to a method for removing blocking 
artefacts from the frame of a digital video signal, which 
has been coded by blocks and then decoded. The cod- 
ing method for a block Is selected according to a pre- 
determined set of coding types. A certain number of 
pixels (n) are selected for examination from both sides of 
a block boundary (30). The value of the pixels selected 
for examination is corrected by filtering, and the number 
of pixels (n) selected for examination depends on the 
image content of the frame in the environment of the 
block boundary (30)., and on the block types of the 
frame in the environment of the block boundary (30). 



Fig. 5 
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